System and method for network function virtualization resource management

ABSTRACT

Systems and methods for network function virtualization (NFV) resource management are disclosed that include receiving, by a network functions virtualization orchestrator (NFVO), a reuse requirement for a first network service (NS) and determining, by the NFVO, that at least one constituent virtual network function (VNF) instance in the first NS is retainable for reuse in a second NS according to the reuse requirement when the first NS is to be terminated. In some embodiments, these systems and methods also include retaining, by the NFVO, the at least one constituent VNF instance in the first NS for reuse in the second NS.

This application is a continuation of U.S. patent application Ser. No.15/247,652, filed on Aug. 25, 2016 and entitled “System and Method forNetwork Function Virtualization Resource Management,” which claimspriority to U.S. Provisional Patent Application No. 62/209,642, filedAug. 25, 2015 and entitled “System and Method for Virtualized NetworkFunction Instance Utilization,” and also claims priority to U.S.Provisional Patent Application No. 62/239,655, filed Oct. 9, 2015 andentitled “VNFM Interaction with VIM for NFV Quota Resource Management,”which are incorporated herein by reference as if reproduced in theirentireties.

TECHNICAL FIELD

The present disclosure relates to network function virtualization (NFV),and, in particular embodiments, to a system and method for NFV resourcemanagement.

BACKGROUND

NFV is an industry effort to transform the way that network operatorsarchitect networks by evolving standard IT virtualization technology toconsolidate many network equipment types onto industry standard highvolume servers, switches and storage, with the goal of cost reductionand efficient network operation and performance. In non-virtualizednetworks, network functions (NFs) are implemented as a combination ofvendor specific software and hardware. By contrast, in NFV environment,NFs are separated from the hardware they run on using virtual hardwareabstraction to virtualize entire classes of NFs into building blocksthat may be connected, or chained, together to create communicationservices.

SUMMARY

In one embodiment, a method is disclosed for network functionvirtualization (NFV) resource management that includes receiving, by anetwork functions virtualization orchestrator (NFVO), a reuserequirement for a first network service (NS) and determining, by theNFVO, that at least one constituent virtual network function (VNF)instance in the first NS is retainable for reuse in a second NSaccording to the reuse requirement when the first NS is to beterminated. In some embodiments, this method also include retaining, bythe NFVO, the at least one constituent VNF instance in the first NS forreuse in the second NS.

In another embodiment, a method is disclosed for network functionvirtualization (NFV) resource management that includes receiving, by anetwork functions virtualization orchestrator (NFVO), a reuserequirement for a network service (NS), and determining, by the NFVO,whether at least one retained virtual network function (VNF) instance isavailable for the NS according to the reuse requirement. In someembodiments, this method also include reusing, by the NFVO, the at leastone retained VNF instance for the NS.

In another embodiment, a network functions virtualization orchestrator(NFVO) is disclosed that includes a memory storage comprisinginstructions and one or more processors in communication with thememory. The one or more processors execute the instructions to receive areuse requirement for a first network service (NS), determine whether atleast one constituent virtual network function (VNF) instance in thefirst NS is capable of being retained for reuse in a second NS accordingto the reuse requirement when the first NS is to be terminated, andretain the at least one constituent VNF instance in the first NS forreuse in the second NS.

In another embodiment, a network functions virtualization orchestrator(NFVO) is disclosed that comprises a memory storage comprisinginstructions and one or more processors in communication with thememory. The one or more processors execute the instructions to receive areuse requirement for a network service (NS), determine whether at leastone retained virtual network function (VNF) instance is capable of beingreused for the NS according to the reuse requirement, and reuse the atleast one retained VNF instance for the NS.

In another embodiment, a method is disclosed for network functionvirtualization (NFV) resource management that includes receiving, by avirtual network function manager (VNFM), from a virtualizedinfrastructure manager (VIM) through an interface between the VNFM andthe VIM quota information that indicates a maximum number of resourcesthat are permitted to be allocated to the VNFM or to one or more VNFinstances managed by the VNFM and performing, by the VNFM a resourcemanagement operation based on the quota information.

In yet another embodiment, a virtual network function manager (VNFM) isdisclosed that includes a memory storage comprising instructions and oneor more processors in communication with the memory. The one or moreprocessors execute the instructions to receive from a virtualizedinfrastructure manager (VIM) through an interface between the VNFM andthe VIM quota information that indicates a maximum number of resourcesthat are permitted to be allocated to the VNFM or to one or more VNFinstances managed by the VNFM, and perform a resource managementoperation based on the quota information.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present disclosure, and theadvantages thereof, reference is now made to the following descriptionstaken in conjunction with the accompanying drawing, in which:

FIG. 1 illustrates a schematic diagram of an embodiment of an NFVsystem;

FIG. 2 illustrates a flow diagram of an embodiment of a method for NFVresource management;

FIG. 3 illustrates a flow diagram of another embodiment of a method forNFV resource management;

FIG. 4 illustrates a flow diagram of another embodiment of a method forNFV resource management;

FIG. 5 illustrates a flow diagram of another embodiment of a method forNFV resource management;

FIG. 6 illustrates a flow diagram of another embodiment of a method forNFV resource management;

FIG. 7 illustrates a flow diagram of yet another embodiment of a methodfor NFV resource management; and

FIG. 8 illustrates a block diagram of an embodiment processing systemfor performing the methods described herein.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

It should be understood at the outset that, although an illustrativeimplementation of one or more embodiments are provided below, thedisclosed systems, apparatuses, and/or methods may be implemented usingany number of techniques, whether currently known or in existence. Thedisclosure should in no way be limited to the illustrativeimplementations, drawings, and techniques illustrated below, includingthe exemplary designs and implementations illustrated and describedherein, but may be modified within the scope of the appended claimsalong with their full scope of equivalents. While certain aspects ofconventional technologies have been discussed to facilitate the presentdisclosure, applicants in no way disclaim these technical aspects, andit is contemplated that the present disclosure may encompass one or moreof the conventional technical aspects discussed herein.

FIG. 1 is a schematic diagram of an embodiment of an NFV system 100 foruse in various embodiments of the disclosed systems and methods. Some ofthis system is described in Network Functions Virtualization (NFV):Management and Orchestration (NFV-MANO), ETSI NFV-MAN 001 v1.1.1(2014-12), which is hereby incorporated into this application in itsentirety by reference. The NFV system 100 may comprise an NFV Managementand Orchestration (NFV-MANO) entity 128, an NFV Infrastructure (NFVI)entity 126, a virtual function entity 140, and one or more OperationsSupport Systems (OSSs) and Business Support Systems (BSSs) (OSS/BSS)124. The virtual function entity 140 may comprise a plurality of virtualnetwork function (VNF) elements 160, 162, and 164, a plurality ofelement management system (EMS) elements 170, 172, and 174 that can beconfigured to perform the typical management functionality for theplurality of VNF elements 160, 162, and 164. In the while three (3) VNFand EMS elements are shown in FIG. 1, it is expressly contemplated thatany number of these elements may be found in a system, and the selectionof three is purely for the purpose of convenience. Moreover, it isunderstood that alternate configurations are contemplated by thisdisclosure, e.g., where a plurality of VNF elements 160, 162, and 164are controlled by a single EMS.

The VNF elements are used to perform a virtualisation of a networkfunction in a non-virtualized network. For example, the networkfunctions in the non-virtualised network may be 3GPP Evolved Packet Core(EPC) network elements, e.g. Mobility Management Entity (MME), ServingGateway (SGW), Packet Data Network Gateway (PGW); elements in a homenetwork, e.g. Residential Gateway (RGW); and conventional networkfunctions, e.g. Dynamic Host Configuration Protocol (DHCP) servers,firewalls, etc. For example, VNF 160 can be composed of one or moreinternal components, called virtualised network function components(VNFCs). Each VNFC provides a defined sub-set of that VNF'sfunctionality, with the main characteristic that a single instance ofthis component maps 1:1 against a single virtualisation container. Forexample, one VNF can be deployed over multiple Virtual Machines (VMs),where each VM hosts a VNFC of the VNF. However, in some cases, the wholeVNF can be deployed in a single VM as well. A VM may be virtualizedcomputation environment that behaves like a physical computer or server,which has all its ingredients (processor, memory/storage,interfaces/ports) of a physical computer/server and is generated by ahypervisor, which partitions the underlying physical resources andallocates them to VMs. A hypervisor may be piece of software whichpartitions the underlying physical resources and creates virtualmachines, and isolates the virtual machines from each other.

The NFV-MANO entity 128 may be responsible for the operation,management, and coordination of VNF elements 160, 162, and 164 and therespective NFVI entity 126. The NFV-MANO entity 128 may comprise an NFVOrchestrator (NFVO) entity 102, one or more VNF manager (VNFM) entities104, and one or more Virtualized Infrastructure Manager (VIM) entities106. The NFVO entity 102 can manage the network service (NS) lifecycleand coordinates the management of NS lifecycle, VNF lifecycle (supportedby the VNFM entity 104) and NFVI resources (supported by the VIM entity106) to ensure an optimized allocation of the necessary resources andconnectivity. The VNFM entity 104 may communicate with VNF elements 160,162, and 164 and be responsible for VNF lifecycle management (e.g.instantiation, update, query, scaling, and termination). For example, inone embodiment a VNFM entity 104 may be deployed for each VNF elements160, 162, and 164. In other embodiments, a VNFM entity 104 may servemultiple VNF elements 160, 162, and 164. The VIM entity 106 can beresponsible for controlling and managing the NFVI compute, storage andnetwork resources. In other words, the VIM entity 106 may be configuredto control and manage the interaction of a VNF with the compute, storageand network resources in NFVI entity 126. For example, the VIM entity106 may perform resource management functions, such as management ofinfrastructure resource and allocation (e.g. increase resources to VMs,improve energy efficiency, and resource reclamation). The VIM entity 106and the VNFM entity 104 may communicate with each other for resourceallocation requests and to exchange virtualized hardware resourceconfiguration and state information.

The NFVI entity 126 represents various hardware and software componentswhich build up the environment in which VNFs are deployed, managed andexecuted. For example, the hardware components in the NFVI entity 126may include computing hardware 112, storage hardware 114, and networkhardware 116 that provide processing, storage and connectivity to VNFentities 160, 162, and 164 through a virtualization layer 130. Thecomputing hardware 112 may be any device configured to, designed to, orotherwise enabled to provide processing and computing resources. Thestorage hardware 114 may be any kind of device which is used to storeinformation for later retrieval. Examples of storage devices includeflash memory, magnetic rotation disks, optical disks, or any othermechanism capable of storing information for later retrieval. Storagehardware 114 may be differentiated between shared network attachedstorage (NAS) and local storage that is connected directly to the NFVIusing an internal bus or other attachment mechanism. In one embodiment,the resources from the computing hardware 112 and storage hardware 114may be pooled together. The network hardware 116 may be switches that isconfigured to perform switching functions, e.g. routers, and wired orwireless links. The network hardware 116 may span across a plurality ofnetwork domains.

The virtualization layer 130 within the NFVI entity 126 may abstract thehardware resources, i.e., computing hardware 112, storage hardware 114,and network hardware 116 and decouple one or more of the VNF elements160, 162, and 164 from the underlying hardware. For example, thevirtualization layer 130 may be responsible for abstracting andlogically partitioning hardware resources, enabling the software thatimplements the VNF to use the underlying virtualized infrastructure, andproviding virtualized resources to the VNF entity. The virtualizedresources controlled by the Virtualization Layer 130 may include avirtual computing 110, a virtual storage 118, and a virtual network 120.

Virtual resources consume physical resources. The reuse of virtualresources is may be advantageous to optimize the use and availability ofphysical resources. For the purposes of this disclosure, a reuserequirement is intended to refer to any criteria that may be used todetermine if a VNF instance is to be retained or reused.

A reuse requirement is a criterion that is configured to be used by theNFVO to determine whether to retain, reuse, release or otherwise takeactions to an existing VNF instance. For example, the reuse requirementspecifies a requirement in accordance with which a constituent VNFinstance of a specific NS is retainable for reuse. In another example,the reuse requirement specifies a requirement in accordance with which aretained VNF instance is capable of being reused for a NS. In someembodiments, the reuse requirement may be set by the OSS with at leastone of security, redundancy or resource consideration. It is expresslycontemplated that, in some embodiments, the reuse requirement may beimplemented as a reuse policy, reuse constraint, reuse rule, reusecriterion or any other desirable forms. The reuse requirement allows theNFVO to determine whether to retain constituent VNF instances of the NS1for reuse in other NS when the NS1 is to be terminated. Alternatively,the reuse requirement may allow the NFVO to determine whether to reusethe retained VNF instance for NS2.

FIG. 2 illustrates a flow diagram of an embodiment of a method 200 forNFV resource management. It is expressly understood that the embodimentmethod 200 may be carried out in the context of the NFV system asillustrated in FIG. 1.

At step 202, a NFVO receives a reuse requirement for a first NS. Forexample, the reuse requirement may be received from an OSS or othermanagement entity which create the reuse requirement through aninteraction mechanism, such as an application programming interface(API), an interaction message etc.

At step 204, the NFVO determines whether at least one constituent VNFinstance in the first NS is capable of being retained for reuse in asecond NS according to the reuse requirement. For example, thedetermination may be trigger when the first NS is to be terminated.

At step 206, if it is determined that at least one constituent VNFinstance in the first NS is capable of being retained, the NFVO retainsthe at least one constituent VNF instance in the first NS for futurereuse in the second NS.

At step 208, if it is determined that no constituent VNF instance in thefirst NS is capable of being retained, the NFVO then release constituentVNF instances in the first NS.

By retaining VNF instances for future reuse, rather than releasing theseVNF instances, some cost and time to create these VNF instances forother NS may be saved. In addition, the OSS is responsible for servicerelated management, while the NFVO is responsible for resource relatedmanagement as well as VNF lifecycle management. As the determination onwhether to retain VNF instances is made according to the received reuserequirement by the NFVO, instead of the OSS, the overall response timeand the high traffic exchange between the OSS and the NFVO on VNF reusemanagement operations can also be reduced. The efficiency of VNFmanagement operations is improved, and a more flexible deployment on VNFmanagement operations is provided.

FIG. 3 illustrates a flow diagram of another embodiment of a method 300for NFV resource management. It is expressly understood that theembodiment method 300 may be carried out in the context of the NFVsystem as illustrated in FIG. 1.

At step 302, a NFVO receives a reuse requirement for a NS. For example,the reuse requirement may be received from an OSS or other managemententity which create the reuse requirement through an interactionmechanism, such as an application programming interface (API), aninteraction message etc.

At step 304, the NFVO determines whether at least one retained VNFinstance is capable of being reused for the NS according to the reuserequirement. For example, the determination may be triggered when the NSis to be instantiated or scaled out.

At step 306, if it is determined that at least one retained VNF instanceis capable of being reused, the NFVO reuses the at least one retainedVNF instance for the NS.

At step 308, if it is determined that no retained VNF instance iscapable of being reused, the NFVO then creates constituent VNF instancesneeded for the NS. For example, the NFVO may instantiate constituent VNFinstances needed for the NS.

It is expressly understood that selected features of the exampleembodiment of FIG. 3 may be combined with selected features of theexample embodiment of FIG. 2.

By reusing retained VNF instances for a NS, rather than creating new VNFinstances, some cost and time may be saved. In addition, the OSS isresponsible for service related management, while the NFVO isresponsible for resource related management as well as VNF lifecyclemanagement. As the determination on whether to reuse VNF instances ismade according to the received reuse requirement by the NFVO, instead ofthe OSS, the overall response time and the high traffic exchange betweenthe OSS and the NFVO on VNF reuse management operations can also bereduced. The efficiency of VNF management operations is improved, and amore flexible deployment on VNF management operations is provided.

FIG. 4 illustrates a flow diagram of another embodiment of a method 400for NFV resource management. It is expressly understood that theembodiment method 400 may be carried out in the context of the NFVsystem as illustrated in FIG. 1.

FIG. 4 includes the use of a network service descriptor (NSD). A NSD isa deployment template which consists of information used by the NFVO forlife cycle management of an NS. For example, the NSD may include servicetopology (such as constituent VNFs and the relationships between them,Virtual Links, VNF Forwarding Graphs) as well as Network Servicecharacteristics and any other artefacts necessary for the NS on-boardingand lifecycle management. In some implementations, the NSD may beprovided to the NFVO from the OSS by on-board NSD operation. Forexample, the NSD may be sent in an OnboardNsdRequest message to the NFVOthrough a NSD management interface.

At step 402, the OSS 124 creates a NSD for a NS1 including a reuserequirement and sends the NSD for the NS1 to the NFVO 102. In addition,the OSS 124 transmits an instantiation request for the NS1 to the NFVO102 to request an instantiation of the NS1. For example, the OSS 102 maysend the instantiation request for the NS1 to the NFVO 124 through a NSinterface, such as a lifecycle management interface.

A lifecycle management interface is a connection between the OSS 124 andthe NFVO 102 capable of communicating data requests, including, but notlimited to a network data connection. The lifecycle management interfacecan used to provide runtime notifications related to the state of theVNF instance, as a result of changes made to VNF instance including (notlimited to) changes in the number of VDUs, changing VNF configurationand/or topology due to auto-scaling/update/upgrade/termination,switching to/from standby, as well as other functions. Thesenotifications facilitate updating consuming functional blocks regardingcompletion of operations that may have been triggered earlier (e.g. forkeeping the NFV instances catalogue updated and/or the elementmanagement (EM) updated). It is understood that when the VNF LifecycleManagement interface is produced by the VNFM entity 104, then the VNFMcan also produce the VNF Lifecycle Changes Notification interface. Whenthe VNF Lifecycle Management interface is produced by the NFVO 102, thenthe NFVO 102 can also produce the VNF Lifecycle Changes Notificationinterface.

In this embodiment, the NSD includes a reuse requirement for constituentVNFs in the NS1. In some implementations, the reuse requirement may beindicated by an indicator or information element included in the NSD forthe NS1. While not shown in FIG. 4, it is explicitly understood that, insome embodiments, the reuse requirement may be provided to the NFVO 102through other suitable message from the OSS 124 to the NFVO 102, insteadof the NSD for the NS1 or OnboardNsdRequest message.

At step 404, when the NFVO 102 receives the instantiation request forthe NS1, it is assumed that no retained VNF instances currently exist.According to the NSD for the NS1, the NS1 needs two constituent VNFinstances: a PGW VNF instance 420 and an MME VNF instance 422. Inresponse to the instantiation request for the NS1, the NFVO 102instantiates the NS1 with instantiating the PGW VNF instance 420 and theMME VNF 422 instance needed for the NS1. It is also understood that anynumber or types of VNF instances may be implemented to realize the NS1,and the implementation as illustrated in FIG. 4 is purely for thepurpose of convenience.

At step 406, the OSS 124 decides to terminate the NS1, and sends atermination request for the NS1 to the NFVO 102 to ask a termination ofthe NS1. For example, the termination request may be sent to the NFVO102 through a NS lifecycle management interface.

At step 408, in response to the termination request, the NFVO 102determines whether the constituent VNF instances in the NS1 (i.e., thePGW VNF instance 420 and MME VNF instance 422) meet the reuserequirement and thus are capable of being retained. If it is determinedthat the constituent VNF instances in the NS1 meet the reuse requirementand thus are capable of being retained, then executes step 410.

In some embodiments, multiple types or forms of reuse requirementsdescribed below may be used alone or in combination with one another.

In one of these embodiments, the reuse requirement may be a capacity orload requirement for one or more constituent VNF instances capable ofbeing retained. For example, the load requirement specifies that theload of the constituent VNF instance capable of being retained isrequired to be equal or less than a threshold value. In another example,the capacity requirement specifies that the remaining capacity of theconstituent VNF instance capable of being retained is required to beequal or greater than a threshold value, e.g., 50%. It is expresslycontemplated that any suitable threshold value may be set, and theselection of 50% is purely for the purpose of illustration. If the NFVOfinds out that the remaining capacity of each of the PGW VNF instanceand MME VNF instance in the NS1 is equal or greater than 50%, the NFVOthen determines that the PGW VNF instance and MME VNF instance in theNS1 meet the reuse requirement and are capable of being retained.

In another of these embodiments, the reuse requirement may be a locationconstraint for one or more constituent VNF instances capable of beingretained. For example, the location constraint may specify that a PGWVNF instance in geographic location 1 is capable of being retained andthat an MME VNF instance in geographic location 2 is capable of beingretained. If the NFVO finds out that the geographic locations of the PGWVNF instance and the MME VNF instance in the NS1 meet the locationconstraint, the NFVO then determines that the PGW VNF instance and MMEVNF instance in the NS1 are capable of being retained. It is alsounderstood that the location constraint may be set to specify that aconstituent VNF instance in certain location cannot be retained.

In another of these embodiments, the reuse requirement may be a VNFrelationship rule. For example, the VNF relationship rule may specifythat constituent VNF instances with certain relationship between themcan be retained together. If the NFVO finds out that the relationshipbetween the PGW VNF instance and the MME VNF instance in the NS1 matchesthe VNF relationship rule, the NFVO then determines that the PGW VNFinstance and MME VNF instance in the NS1 are capable of being retainedtogether. In another example, the VNF relationship rule may specify thatconstituent VNF instances with certain relationship between them cannotbe retained together. It is expressly understood that the VNFrelationship rule may be set in light of vendor, security or functionconsiderations.

In another of these embodiments, the reuse requirement may be a NS typeconstraint. For example, the NS type constraint may specify that aconstituent VNF instance in a given type of NS can be retained. If theNFVO finds out that the NS1 meets the NS type constraint, the NFVO thendetermines that the PGW VNF instance and MME VNF instance in the NS1 arecapable of being retained. It is also understood that the NS typeconstraint may be set that a constituent VNF instance in a given type ofNS cannot be retained.

In another of these embodiments, the reuse requirement may be a VNF typeconstraint. For example, the VNF type constraint may specify that one ormore given types of constituent VNF instances can be retained. If theNFVO finds out that the PGW VNF instance and the MME VNF instance in theNS1 match the VNF type constraint, the NFVO then determines that the PGWVNF instance and MME VNF instance in the NS1 are capable of beingretained. It is also understood that the VNF type constraint may be setto specify that one or more given types of constituent VNF instancescannot be retained.

In yet another of these embodiments, the reuse requirement may relate toa reusable time period in which one or more constituent VNF instancesare allowed to be used. When the reusable time period expires, the oneor more constituent VNF instances need to be released. For example, thereusable time period may be set as 30 days for the PGW VNF instance andthe MME VNF instance in the NS1. If the NFVO finds out that the PGW VNFinstance and the MME VNF instance in the NS1 have been just used for 2days, the NFVO then determines that the PGW VNF instance and MME VNFinstance in the NS1 are capable of being retained.

At step 410, if the NFVO determines that the PGW VNF instance 420 andMME VNF instance 422 in the NS1 meet the reuse requirement and thus arecapable of being retained, the NFVO then deletes the NS1 and retains thePGW VNF instance 420 and MME VNF instance 422 for future reuse in otherNSs, instead of releasing the PGW VNF instance 420 and MME VNF instance422. In some embodiments, the NFVO puts the retained VNF instances intoa reusable VNF pool and removes all configurations for the PGW VNFinstance 420 and MME VNF instance 422 in the NS1. For example, thereusable VNF pool may be implemented as a database to keep track ofthose retained VNF instances status. It is expressly contemplated thatany other suitable mechanisms may be implemented to keep those retainedVNF instances alive and to keep track of them, the selection of the poolmechanism is purely for the purpose of illustration. For example, theNFVO may instead maintain a list of retained VNF instances.

While not shown in FIG. 4, it is explicitly understood that, in someembodiments, if the NFVO determines that the PGW VNF instance and MMEVNF instance in the NS1 do not meet the reuse requirement, the NFVO thenreleases the PGW VNF instance and MME VNF instance and delete the NS1.

Moreover, it is also understood that the NS termination operation asdescribed above is just an example for the purpose of illustration.Other types of NS lifecycle management operations could also be appliedin this embodiment method.

By retaining VNF instances of a terminated NS for future reuse, ratherthan releasing these VNF instances, some cost and time to create theseVNF instances for other NS may be saved. In addition, the OSS isresponsible for service related management, while the NFVO isresponsible for resource related management as well as VNF lifecyclemanagement. As the determination on whether to retain VNF instances ismade according to the received reuse requirement/policy by the NFVO,instead of the OSS, the overall response time and the high trafficexchange between the OSS and the NFVO on VNF reuse management operationscan also be reduced. The efficiency of VNF management operations isimproved, and a more flexible deployment on VNF management operations isprovided.

In one embodiment of the present disclosure, a NFVO including means forreceiving a reuse requirement for a first NS and means for determiningwhether at least one constituent VNF instance in the first NS is capableof being retained for reuse in a second NS according to the reuserequirement when the first NS is to be terminated is disclosed. Theembodiment of NFVO also includes means for retaining the at least oneconstituent VNF instance in the first NS for reuse in the second NS. Itis expressly understood that this NFVO embodiment may be operatedconsistent with the method embodiments as illustrated in FIG. 2 and FIG.4. With respect to detailed implementations of this NFVO embodiment,reference can be made to the above-mentioned method embodiments.

FIG. 5 illustrates a flow diagram of another embodiment of a method 500for NFV resource management. It is expressly understood that theembodiment method 500 may be carried out in the context of the NFVsystem as illustrated in FIG. 1.

At step 502, the OSS 124 creates a NSD for a NS2 including a reuserequirement and sends the NSD for the NS2 to the NFVO 102. In someimplementations, the NSD may be provided to the NFVO from the OSS 124 byon-board NSD operation. For example, the NSD may be sent in anOnboardNsdRequest message to the NFVO 102 through a NSD managementinterface. In addition, the OSS transmits an instantiation request forthe NS2 to the NFVO 102 to request an instantiation of the NS2. Forexample, the OSS 124 may send the instantiation request for the NS2 tothe NFVO 102 through a NS lifecycle management interface.

In this embodiment, the NSD for the NS2 includes a reuse requirement forconstituent VNFs in the NS2. In some implementations, the reuserequirement may be indicated by an indicator or information elementincluded in the NSD for the NS2. While not shown in FIG. 5, it isexplicitly understood that, in some embodiments, the reuse requirementmay be provided to the NFVO through other suitable message from the OSS124 to the NFVO 102, rather than the NSD for the NS2 orOnboardNsdRequest message.

The reuse requirement is configured to be used by the NFVO 102 todetermine how to reuse retained VNF instances for the NS2. For example,the reuse requirement specifies a requirement in accordance with which aretained VNF instance is capable of being reused for the NS2. In someembodiments, the reuse requirement may be set by the OSS with at leastone of security, redundancy or resource consideration. It is expresslycontemplated that, in some embodiments, the reuse requirement may beimplemented as a reuse policy, reuse constraint, reuse rule, reusecriterion or any other desirable forms. It is also understood that thereuse requirement as described in the embodiment of FIG. 5 may be usedalone or in combination with the reuse requirement as described in theembodiment of FIG. 4.

At step 504, in response to the instantiation request for the NS2, theNFVO 102 checks a reusable VNF pool and determines whether at least oneretained VNF instance in the reusable VNF pool meets the reuserequirement for the NS2. The reusable VNF pool, for example, includesthree retained VNF instances: a PGW VNF instance 1 520, a PGW VNFinstance 2 524 and a MME VNF instance 522. According to the NSD for theNS2, the NS2 needs two constituent VNF instances: a PGW VNF instance andan MME VNF instance 522. Thus the NFVO needs to determine whether thethree retained VNF instances meet the reuse requirement. If it isdetermined that the retained PGW VNF instance 1 520 and MME VNF instance522 meet the reuse requirement and thus are capable of being reused forthe NS2, then executes step 506.

It is also understood that any number or types of VNF instances may beimplemented with respect to the NS2 and the reusable VNF pool, and theimplementation as illustrated in FIG. 5 is purely for the purpose ofillustration.

In some embodiments, multiple types or forms of reuse requirementsdescribed below may be used alone or in combination with one another.

In one of these embodiments, the reuse requirement may be a capacity orload requirement for one or more retained VNF instances capable of beingreused. For example, the load requirement specifies that the load of theretained VNF instance capable of being reused is required to be equal orless than a threshold value. In another example, the capacityrequirement specifies that the remaining capacity of the retained VNFinstance capable of being reused is required to be equal or greater thana threshold value, e.g., 70%. It is expressly contemplated that anysuitable threshold value may be set, and the selection of 70% is purelyfor the purpose of illustration. If the NFVO finds out that theremaining capacity of each of the retained PGW VNF instance 1 520 andMME VNF instance 522 in the reusable VNF pool is equal or greater than70%, the NFVO then determines that the retained PGW VNF instance 1 520and MME VNF instance 522 meet the reuse requirement and are capable ofbeing reused for the NS2.

In another of these embodiments, the reuse requirement may be a locationconstraint for one or more retained VNF instances capable of beingreused for the NS2. For example, the location constraint may specifythat a PGW VNF instance in geographic location 1 is capable of beingreused and that an MME VNF instance 522 in geographic location 2 iscapable of being reused. If the NFVO finds out that the geographiclocations of the retained PGW VNF instance 1 520 and the MME VNFinstance 522 in the reusable VNF pool meet the location constraint, theNFVO then determines that the PGW VNF instance 1 520 and MME VNFinstance 522 are capable of being reused. It is also understood that thelocation constraint may be set to specify that a retained VNF instancein certain location cannot be reused.

In another of these embodiments, the reuse requirement may be a VNFrelationship rule. For example, the VNF relationship rule may specifythat retained VNF instances with certain relationship between them canbe reused together for the NS2. If the NFVO 102 finds out that therelationship between the retained PGW VNF instance 1 520 and the MME VNFinstance 522 in the reusable VNF pool matches the VNF relationship rule,the NFVO then determines that the retained PGW VNF instance 1 520 andMME VNF instance 522 are capable of being reused together. In anotherexample, the VNF relationship rule may specify that retained VNFinstances with certain relationship between them cannot be reusedtogether for the NS2. It is expressly understood that the VNFrelationship rule may be set in light of vendor, security or functionconsiderations.

In another of these embodiments, the reuse requirement may be a NS typeconstraint. For example, the NS type constraint may specify that aretained VNF instance can be reused for a given type of NS. If the NFVO102 finds out that the NS2 meets the NS type constraint, the NFVO 102then determines that the retained PGW VNF instance 1 520 and MME VNFinstance 522 in the reusable VNF pool are capable of being reused. It isalso understood that the NS type constraint may be set that a retainedVNF instance cannot be reused for a given type of NS.

In another of these embodiments, the reuse requirement may be a VNF typeconstraint. For example, the VNF type constraint may specify that one ormore given types of retained VNF instances can be reused for the NS2. Ifthe NFVO finds out that the retained PGW VNF instance 1 520 and the MMEVNF instance 522 in the reusable VNF pool match the VNF type constraint,the NFVO then determines that the PGW VNF instance 1 520 and MME VNFinstance 522 are capable of being reused. It is also understood that theVNF type constraint may be set that one or more given types of retainedVNF instances cannot be reused for the NS2.

In another of these embodiments, the reuse requirement may be a NSnumber constraint. For example, the NS number constraint may indicate amaximum number of NSs that are permitted to reuse a retained VNFinstance simultaneously. If the NFVO finds out that the NS numberconstraint is matched, the NFVO then determines that the PGW VNFinstance 1 and MME VNF instance are capable of being reused.

In yet another of these embodiments, the reuse requirement may relate toa reusable time period in which one or more constituent VNF instances inNS2 are allowed to be used. When the reusable time period expires, theone or more constituent VNF instances need to be released. For example,the reusable time period for one or more constituent VNF instances inthe NS2 may be set as 20 days. If the NFVO finds out that the remainingreusable time period for each of the retained PGW VNF instance 1 520 andthe MME VNF instance 522 exceeds 20 days, the NFVO then determines thatthe PGW VNF instance 1 520 and MME VNF instance 522 meet the reuserequirement and thus are capable of being reused for the NS2.

At step 506, the NFVO then instantiates the NS2 with reusing retainedPGW VNF instance 1 520 and MME VNF instance 522 that meet the reuserequirement for NS2. In particular, the NFVO adds the PGW VNF instance 1520 and MME VNF instance 522 into the NS2 and configures the PGW VNFinstance 1 520 and MME VNF instance 522 for the NS2.

While not shown in FIG. 5, it is explicitly understood that, in someembodiments, if the NFVO determines that no retained VNF instance in thereusable VNF pool meets the reuse requirement for the NS2, the NFVOinstead instantiates a PGW VNF instance and a MME VNF instance 522 toinstantiate the NS2.

At step 508, the OSS transmits a scale-out request for the NS2 to theNFVO, in order to add a new PGW VNF instance. For example, the OSS maysend the scale-out request to the NFVO 102 through a lifecyclemanagement interface.

At step 510, in response to the scale-out request for the NS2, the NFVOchecks the reusable VNF pool and determines whether at least oneretained VNF instance in the reusable VNF pool meets the reuserequirement for the NS2. It is assumed that the reusable VNF pool, forexample, currently includes the PGW VNF instance 2 524. Thus the NFVOneeds to determine whether the retained PGW VNF instance 2 524 meets thereuse requirement. If it is determined that the retained PGW VNFinstance 2 524 meets the reuse requirement and thus is capable of beingreused for the NS2, then executes step 512.

At step 512, the NFVO 102 then scales out the NS2 with reusing theretained PGW VNF instance 2 524 that meets the reuse requirement forNS2. In particular, the NFVO adds the PGW VNF instance 2 524 into theNS2 and configures the PGW VNF instance 2 524 for the NS2.

While not shown in FIG. 5, it is explicitly understood that, in someembodiments, if the NFVO determines that no retained VNF instance in thereusable VNF pool meets the reuse requirement for the NS2, the NFVOinstead instantiates or creates a PGW VNF instance to scale out the NS2.

Moreover, it is also understood that the NS instantiation and scalingoperations described above are just examples for the purpose ofillustration. Other types of NS lifecycle management operations couldalso be applied in this embodiment method. The NS lifecycle managementoperations may include, but not limited to, instantiation, termination,scaling, updating and healing operation etc.

It is also understood that selected features of the example embodimentof FIG. 5 may be combined with selected features of the exampleembodiment of FIG. 4.

By reusing retained VNF instances for a NS, rather than creating new VNFinstances, some cost and time may be saved. In addition, the OSS isresponsible for service related management, while the NFVO isresponsible for resource related management as well as VNF lifecyclemanagement. As the determination on whether to reuse VNF instances ismade according to the received reuse requirement/policy by the NFVO,instead of the OSS, the overall response time and the high trafficexchange between the OSS and the NFVO on VNF reuse management operationscan also be reduced. The efficiency of VNF management operations isimproved, and a more flexible deployment on VNF management operations isprovided.

In one embodiment of the present disclosure, a NFVO including means forreceiving a reuse requirement for a NS and means for determining whetherat least one retained VNF instance is capable of being reused for the NSaccording to the reuse requirement is disclosed. The embodiment of NFVOalso includes means for reusing the at least one retained VNF instancefor the NS. It is expressly understood that this NFVO embodiment may beoperated consistent with the method embodiments as illustrated in FIG. 3and FIG. 5. With respect to detailed implementations of this NFVOembodiment, reference can be made to the above-mentioned methodembodiments.

FIG. 6 illustrates a flow diagram of another embodiment of a method forNFV resource management. It is expressly understood that the embodimentmethod 600 may be carried out in the context of the NFV system asillustrated in FIG. 1.

At step 602, the VNFM 104 sends to the VIM 106 a quota query request forquerying quota information. The quota query request is sent through aninterface between the VNFM 104 and VIM, i.e., VNFM-VIM interface.

At step 604, in response to the quota query request, the VIM 106 returnsa quota query response including quota information to the VNFM 104. Thequota query response is directly sent to the VNFM 104 through theVNFM-VIM interface without going through the NFVO. For example, thequota information may include quota resource information which specifiesa maximum number of resources that are permitted to be allocated to theVNFM 104 or to the one or more VNF instances managed by the VNFM 104. Inanother example, the quota information may include quota meta-datainformation, or quota status information. The resources allocatedinclude, but not limited to compute resources, network resources, andstorage resources.

At step 606, the VNFM 104 performs a resource management operation basedon the quota information. For example, the resource management operationmay include VNF lifecircle management operation. The VNFM 104 mayrequest resources from the VIM or configure its VNFs according to thequota information received through the VNFM-VIM interface.

By receiving the quota information through the VNFM-VIM interfacewithout going through the NFVO, the overall response time on quota-basedresource management performed by the VNFM may be reduced. The signalingoverhead between the NFVO and VNFM on quota related management is alsoreduced. The efficiency of quota-based resource management is thusimproved.

FIG. 7 illustrates a flow diagram of another embodiment of a method forNFV resource management. It is expressly understood that the embodimentmethod 700 may be carried out in the context of the NFV system asillustrated in FIG. 1.

At step 702, a VNFM 104 sends to a VIM 106 a subscribe request forsubscription to changes on quota. The subscribe request is sent throughan interface between the VNFM 104 and VIM, i.e., VNFM-VIM 106 interface.

At step 704, in response to the subscribe request, the VIM 106 returns asubscribe response with a result of subscription through the VNFM-VIM106 interface. It is assumed that the subscription to changes on quotais successful. It is expressly understood that steps 702-704 areoptional.

At step 706, after successful subscription, the VNFM 104 is registeredto receive notifications related to changes on quota from the VIM. Whenthe quota information is updated, the VIM 106 sends to the VNFM 104 aquota change notification including quota information through theVNFM-VIM 106 interface without going through the NFVO. The quotainformation may include quota change information. For example, the quotachange information may indicate changes on a maximum number of resourcesthat are permitted to be allocated to the VNFM 104 or to the one or moreVNF instances managed by the VNFM. The quota change information mayfurther indicate a change type. It is expressly contemplated that thechange on the maximum number may include a change from 0 to a certainnumber and vice versa. It is also understood that the resourcesallocated to the VNFM 104 include, but not limited to compute resources,network resources, and storage resources.

At step 708, after receiving the quota change notification, the VNFM 104transmits a quota change response to the VIM. It is also understood thisstep is optional.

At step 710, the VNFM 104 performs a resource management operation basedon the quota information. For example, the resource management operationmay include VNF lifecircle management operation. The VNFM 104 mayrequest resources from the VIM 106 or configure its VNFs according tothe quota information received through the VNFM-VIM 106 interface.

By receiving the quota information through the VNFM-VIM 106 interfacewithout going through the NFVO, the overall response time on quota-basedresource management performed by the VNFM 104 may be reduced. Thesignaling overhead between the NFVO and VNFM 104 on quota relatedmanagement is also reduced. The efficiency of quota-based resourcemanagement is thus improved.

In one embodiment of the present disclosure, a VNFM including means forreceiving from a VIM through an interface between the VNFM and the VIMquota information that indicates a maximum number of resources that arepermitted to be allocated to the VNFM or to one or more VNF instancesmanaged by the VNFM is disclosed. This embodiment of VNFM also includesmeans for performing a resource management operation based on the quotainformation. It is expressly understood that this VNFM embodiment may beoperated consistent with the method embodiments as illustrated in FIG. 6and FIG. 7. With respect to detailed implementations of this VNFMembodiment, reference can be made to the above-mentioned methodembodiments.

The following reference is related to subject matter of the presentdisclosure. The reference is incorporated herein by reference in itsentirety: U.S. Provisional Patent Application Ser. No. 62/158,381, filedon May 7, 2015, entitled “System and Method for VNFM Assist NFV QuotaResource Management.”

FIG. 8 illustrates a block diagram of a processing system 800 that maybe used for implementing the methods disclosed herein. Specific devicesmay utilize all of the components shown, or only a subset of thecomponents, and levels of integration may vary from device to device.Furthermore, a device may contain multiple instances of a component,such as multiple processing units, processors, memories, transmitters,receivers, etc. The processing system 800 may comprise a processing unitequipped with one or more input/output devices, such as a speaker,microphone, mouse, touchscreen, keypad, keyboard, printer, 807, adisplay 808, and the like. The processing unit may include a centralprocessing unit (CPU) 810, memory 815, a mass storage device 820, avideo adapter 825, and an I/O interface 830 connected to a bus 835.

The bus 835 may be one or more of any type of several bus architecturesincluding a memory bus or memory controller, a peripheral bus, videobus, or the like. The CPU 810 may comprise any type of electronic dataprocessor. The memory 815 may comprise any type of non-transitory systemmemory such as static random access memory (SRAM), dynamic random accessmemory (DRAM), synchronous DRAM (SDRAM), read-only memory (ROM), acombination thereof, or the like. In an embodiment, the memory 815 mayinclude ROM for use at boot-up, and DRAM for program and data storagefor use while executing programs.

The mass storage device 820 may comprise any type of non-transitorystorage device configured to store data, programs, and other informationand to make the data, programs, and other information accessible via thebus 835. The mass storage device 820 may comprise, for example, one ormore of a solid state drive, hard disk drive, a magnetic disk drive, anoptical disk drive, or the like.

The video adapter 825 and the I/O interface 830 provide interfaces tocouple external input and output devices to the processing unit. Asillustrated, examples of input and output devices include the display807 coupled to the video adapter 825 and the mouse/keyboard/printer 805coupled to the I/O interface 830. Other devices may be coupled to theprocessing unit, and additional or fewer interface devices may beutilized. For example, a serial interface such as Universal Serial Bus(USB) (not shown) may be used to provide an interface for a printer.

The processing system 800 also includes one or more network interfaces850, which may comprise wired links, such as an Ethernet cable or thelike, and/or wireless links to access nodes or different networks 855.The network interface 850 allows the processing system 800 tocommunicate with remote units via the network(s) 855. For example, thenetwork interface 850 may provide wireless communication via one or moretransmitters/transmit antennas and one or more receivers/receiveantennas. In an embodiment, the processing system 800 is coupled to alocal-area network or a wide-area network 855 for data processing andcommunications with remote devices, such as other processing units, theInternet, remote storage facilities, or the like.

Although a combination of features is shown in the illustrated examples,not all of them need to be combined to realize the benefits of variousembodiments of this disclosure. In other words, a system or methoddesigned according to an embodiment of this disclosure will notnecessarily include all of the features shown in any one of the Figuresor all of the portions schematically shown in the Figures. Moreover,selected features of one example embodiment may be combined withselected features of other example embodiments.

While this disclosure has been described with reference to illustrativeembodiments, this description is not intended to be construed in alimiting sense. Various modifications and combinations of theillustrative embodiments, as well as other embodiments of thedisclosure, will be apparent to persons skilled in the art uponreference to the description. It is therefore intended that the appendedclaims encompass any such modifications or embodiments.

What is claimed is:
 1. A method for network function virtualization(NFV) resource management comprising: receiving, by a network functionsvirtualization orchestrator (NFVO), a network service descriptor (NSD)that includes a reuse requirement for a first network service (NS), thereuse requirement requiring that at least one virtual network function(VNF) instance of the first NS be retained after the first NS isterminated; and retaining, by the NFVO, the at least one VNF instance ina second NS according to the reuse requirement included in the NSD. 2.The method of claim 1, wherein the reuse requirement includes a VNFrelationship rule.
 3. The method of claim 2, wherein the at least oneVNF instance includes at least one constituent VNF instance, and whereinthe VNF relationship rule specifies that other constituent VNF instancesof the first NS having a certain relationship with the at least oneconstituent VNF instance are required to be retained together with theat least one constituent VNF instance after the first NS is terminated.4. The method of claim 2, wherein the at least one VNF instance includesat least one constituent VNF instance, and wherein the VNF relationshiprule specifies that other constituent VNF instances having a certainrelationship with the at least one constituent VNF instance are notpermitted to be retained together with the at least one constituent VNFinstance after the first NS is terminated.
 5. The method of claim 1,wherein the at least one VNF instance includes a constituent VNFinstance.
 6. An apparatus comprising: a processor; and a non-transitorycomputer readable storage medium storing programming for execution bythe processor, the programming including instructions to: receive, by anetwork functions virtualization orchestrator (NFVO), a network servicedescriptor (NSD) that includes a reuse requirement for a first networkservice (NS), the reuse requirement requiring that at least one virtualnetwork function (VNF) instance of the first NS be retained after thefirst NS is terminated; and retain, by the NFVO, at least one VNFinstance in a second NS according to the reuse requirement in the NSD.7. The apparatus of claim 6, wherein the reuse requirement includes aVNF relationship rule.
 8. The apparatus of claim 7, wherein the at leastone VNF instance includes at least one constituent VNF instance, andwherein the VNF relationship rule specifies that other constituent VNFinstances of the first NS having a certain relationship with the atleast one constituent VNF instance are required to be retained togetherwith the at least one constituent VNF instance after the first NS isterminated.
 9. The apparatus of claim 7, wherein the at least one VNFinstance includes at least one constituent VNF instance, and wherein theVNF relationship rule specifies that other constituent VNF instanceshaving a certain relationship with the at least one constituent VNFinstance are not permitted to be retained together with the at least oneconstituent VNF instance after the first NS is terminated.
 10. Theapparatus of claim 6, wherein the at least one VNF instance includes aconstituent VNF instance.
 11. A method for network functionvirtualization (NFV) resource management comprising: receiving, by avirtual network function manager (VNFM), a query quota request over aninterface between the VNFM and virtualized infrastructure manager (VIM),the query quota request indicating a quota specifying a number ofvirtual resources that are permitted to be allocated to the VNFM or toone or more virtual network function (VNF) instances managed by theVNFM; and sending, by the VNFM, a subscribe request to the VIM, thesubscribe request requesting a subscription to notifications of changesto the quota.
 12. The method of claim 11, further comprising receiving,by the VNFM in response to the subscribe request, a subscribe responseindicating that a subscription associated with the subscribe request issuccessful.
 13. An apparatus comprising: a processor; and anon-transitory computer readable storage medium storing programming forexecution by the processor, the programming including instructions to:receive, by a virtual network function manager (VNFM), a query quotarequest over an interface between the VNFM and virtualizedinfrastructure manager (VIM), the query quota request indicating a quotaspecifying a number of virtual resources that are permitted to beallocated to the VNFM or to one or more virtual network function (VNF)instances managed by the VNFM; and send, by the VNFM, a subscriberequest to the VIM, the subscribe request requesting a subscription tonotifications of changes to the quota.
 14. The apparatus of claim 13,further comprising receiving, by the VNFM in response to the subscriberequest, a subscribe response indicating that a subscription associatedwith the subscribe request is successful.
 15. A method for networkfunction virtualization (NFV) resource management comprising: receiving,by a network functions virtualization orchestrator (NFVO), a networkservice descriptor (NSD) that includes a reuse requirement for a firstnetwork service (NS), the reuse requirement requiring that at least onevirtual network function (VNF) instance of the first NS be retainedafter the first NS is terminated; terminating, by the NFVO, the firstNS; and retaining, by the NFVO according to the reuse requirementincluded in the NSD, the at least one VNF instance in a second NS afterthe first NS is terminated.
 16. The method of claim 15, wherein thereuse requirement includes a VNF relationship rule.
 17. The method ofclaim 16, wherein the at least one VNF instance includes at least oneconstituent VNF instance, and wherein the VNF relationship rulespecifies that other constituent VNF instances of the first NS having acertain relationship with the at least one constituent VNF instance arerequired to be retained together with the at least one constituent VNFinstance after the first NS is terminated.
 18. The method of claim 16,wherein the at least one VNF instance includes at least one constituentVNF instance, and wherein the VNF relationship rule specifies that otherconstituent VNF instances having a certain relationship with the atleast one constituent VNF instance are not permitted to be retainedtogether with the at least one constituent VNF instance after the firstNS is terminated.